[Testing] Add basic setup and sample tests for Codeception System Tests #16743

yvesh · 2017-06-18T09:46:44Z

Summary of Changes

This pull request adds the basic setup and configuration for the Joomla browser based System Tests. It contains sample tests for com_users. During the next weeks more tests are going to be ported from the system tests repository
. Additionally Continuous Integration will be activated running the test suite for every PR and commit.

Testing Instructions

For a complete description check the README.md in tests/codeception

Prerequisites:

Webserver with PHP installed
Google Chrome
Composer
PHP 5.6 Cli (or later)
Java JDK (8 or later)

Step by Step:

Navigate in your terminal to tests/codeception
Do a composer install
cp and modify the acceptance.suite.dist.yml to acceptance.suite.yml
Navigate back to the root folder of Joomla
Run tests/codeception/vendor/bin/robo run:tests

Expected result

Joomla has System tests

Actual result

Joomla has no System tests

Documentation Changes Required

Yes, parts are already integrated and will be updated the next days.

Thank you to all people working on this topic in the last years!

New integration of Codeception 2.2 dev-master into Joomla

Adds Gherkin Pages and Step Objects as sample of useage

…dSteps2 [tests] new convention for locating elements

Adding testing instructions to readme

Update Codeception to 2.2.1

Adding users.feature scenarios using gherkin

# Conflicts: # RoboFile.php # tests/_support/AcceptanceTester.php # tests/acceptance.suite.dist.yml

Adding content.feature scenarios

Clean up and deletion for core merge

brianteeman · 2017-06-18T09:49:52Z

tests/codeception/README.md

+
+2. Install `composer` in your system. Read more about [how to install composer](https://getcomposer.org/doc/00-intro.md) here.
+
+3. Install composer packages using following steps from root directory of this project.


using the following

brianteeman · 2017-06-18T09:50:07Z

tests/codeception/README.md

+2. Install `composer` in your system. Read more about [how to install composer](https://getcomposer.org/doc/00-intro.md) here.
+
+3. Install composer packages using following steps from root directory of this project.
+We are using `composer.json` file for `tests/codeception` folder, so that you will have to run composer install from tests directory.


from the tests directory

brianteeman · 2017-06-18T09:50:32Z

tests/codeception/README.md

+$ tests\codeception\vendor\bin\robo run:test
+```
+
+If you want to see steps then you can use `--steps` option of codeception. Check [full codecept command list here](http://codeception.com/docs/reference/Commands#Run)_


see the steps

brianteeman · 2017-06-18T09:50:47Z

tests/codeception/README.md

+    $ cd tests/codeception && composer install
+    ```
+
+4. Copy `tests/codeception/acceptance.suite.dist.yml` to `tests/codeception/acceptance.suite.yml` and change settings according to your webserver.


change the settings

brianteeman · 2017-06-18T09:51:28Z

tests/codeception/README.md

+
+If you want to see steps then you can use `--steps` option of codeception. Check [full codecept command list here](http://codeception.com/docs/reference/Commands#Run)_
+
+**Note**:You can modify the timeout time by setting the value of **TIMEOUT** constant lower for fast machines and higher for slow computers. The constant located in the file `tests/codeception/acceptance/_bootstrap.php`


+Note: You can modify the timeout time by setting the value of the TIMEOUT constant lower for fast machines and higher for slow computers. The constant is located in the file tests/codeception/acceptance/_bootstrap.php

brianteeman · 2017-06-18T09:52:12Z

tests/codeception/_support/AcceptanceTester.php

+ * @package     Joomla.Test
+ * @subpackage  AcceptanceTester
+ *
+ * @copyright   Copyright (C) 2005 - 2016 Open Source Matters, Inc. All rights reserved.


brianteeman · 2017-06-18T09:52:21Z

tests/codeception/_support/AcceptanceTester.php

+ * @subpackage  AcceptanceTester
+ *
+ * @copyright   Copyright (C) 2005 - 2016 Open Source Matters, Inc. All rights reserved.
+ * @license     GNU General Public License version 2 or later; see LICENSE


LICENSE.txt

brianteeman · 2017-06-18T09:53:33Z

tests/codeception/_support/AcceptanceTester.php

+ * @subpackage  AcceptanceTester
+ *
+ * @copyright   Copyright (C) 2005 - 2016 Open Source Matters, Inc. All rights reserved.
+ * @license     GNU General Public License version 2 or later; see LICENSE


and the same for all new files

brianteeman · 2017-06-18T09:54:44Z

tests/codeception/_support/Helper/JoomlaDb.php

+	}
+
+	/**
+	 * See an entry in the database


Would this be better as Find in the database and not found in the database?

brianteeman · 2017-06-18T09:57:32Z

tests/codeception/acceptance/administrator/components/com_users/UserCest.php

+	}
+
+	/**
+	 * Edit an user


Edit a user

(the rule is that it is an when before a vowel EXCEPT when the vowel is pronounced as a consonant - which it is in this case YOU-SIR

brianteeman · 2017-06-18T09:58:23Z

tests/codeception/functional.suite.yml

+#
+# Suite for functional (integration) tests
+# Emulate web requests and make application process them
+# Include one of framework modules (Symfony2, Yii2, Laravel5) to use it


one of the framework

This file was generated by codeception, but i still fixed it for us :) Thank you @brianteeman !!

zero-24 · 2017-06-18T10:23:27Z

@yvesh did you already run the script for the header that I did not updated yesterday?

yvesh · 2017-06-18T10:27:06Z

@zero-24 Updated it manually now, because we have too many different subpackage names.

SniperSister · 2017-06-18T10:48:31Z

I have tested this item ✅ successfully on 6ddf0c2

_{This comment was created with the J!Tracker Application at issues.joomla.org/tracker/joomla-cms/16743.}

dneukirchen · 2017-06-18T11:00:20Z

I have tested this item ✅ successfully

brianteeman · 2017-06-18T11:00:20Z

tests/codeception/README.md

+$ tests\codeception\vendor\bin\robo run:test
+```
+
+If you want to see the steps then you can use `--steps` option of codeception. Check [full codecept command list here](http://codeception.com/docs/reference/Commands#Run)_


remove trailing _

yvesh and others added 30 commits May 15, 2016 22:00

System tests with codeception 2.2

5f0d6d6

System tests with codeception 2.2

48b509b

System tests with codeception 2.2

103acea

System tests with codeception 2.2

f54f528

Merge pull request joomla#10 from yvesh/codeception22run

39146ff

New integration of Codeception 2.2 dev-master into Joomla

Instructions for testing

3df9c7e

Instructions for testing

60b986d

Remove useless header

f286325

[tests] new convention for locating elements

97914b7

Adds Gherkin Pages and Step Objects as sample of useage

Merge pull request joomla#15 from javigomez/jab16GherkinpageObjectsan…

c3a4a0f

…dSteps2 [tests] new convention for locating elements

Merge pull request joomla#11 from jsanchezgr/staging

1230d89

Adding testing instructions to readme

Merge remote-tracking branch 'upstream/staging' into staging

500def7

Update Codeception to 2.2.1

0d5d7d3

Writing new composer.lock file for update

8f013c4

Merge pull request joomla#21 from pritalpatel/issue#20

4e49bc0

Update Codeception to 2.2.1

Adding users.feature scenarios using gherkin

9c9dba5

Adding content.feature scenarios using gherkin

4d74878

Adding users.feature file

c219045

Adding scenarios for access level and user group

69413af

Adding Assert module for assertion

3979b9d

Implementing Pageobject

2a3a4ab

Passing $title and $content as a argument

0e0c993

Implement step and page object in users.feature file

c15e369

Merge pull request joomla#25 from pritalpatel/gherkin-feature-users

feccb60

Adding users.feature scenarios using gherkin

Merge remote-tracking branch 'origin/staging' into pr/26

ee31d6e

# Conflicts: # RoboFile.php # tests/_support/AcceptanceTester.php # tests/acceptance.suite.dist.yml

Add missing pages

5349a5a

New approach to manage suite configuration

e347ad9

Merge pull request joomla#27 from javigomez/gherkin-feature-contentb

537b559

Adding content.feature scenarios

Fix the issue_#29 and issue_#31

0cec819

Fix the issue_#30

6ddf0c2

yvesh and others added 5 commits June 18, 2017 10:16

Merge remote-tracking branch 'upstream/staging' into cleantests

1ae5d09

Further cleanup

a01f903

Merge pull request joomla#133 from yvesh/cleantests

2c02867

Clean up and deletion for core merge

Cleanup

2c2d0a2

Cleanup

6409ed7

joomla-cms-bot added PR-staging Unit/System Tests labels Jun 18, 2017

brianteeman reviewed Jun 18, 2017

View reviewed changes

Thank you @brianteeman

1519ce1

brianteeman reviewed Jun 18, 2017

View reviewed changes

Thank you @brianteeman

38f1c40

rdeutz merged commit 5b6abe8 into joomla:staging Jun 18, 2017

rdeutz mentioned this pull request Jun 19, 2017

[RFC] Proposal for namespaced class unit tests #16761

Closed

zero-24 added this to the Joomla 3.7.3 milestone Jun 22, 2017

This was referenced Jun 24, 2017

[System Tests] Fix acceptance.suite.dist.yml #16848

Merged

Update vagrant box to System Tests in CMS core joomla-projects/vagrant-joomla-testing#8

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Testing] Add basic setup and sample tests for Codeception System Tests #16743

[Testing] Add basic setup and sample tests for Codeception System Tests #16743

yvesh commented Jun 18, 2017 •

edited

Loading

brianteeman Jun 18, 2017

brianteeman Jun 18, 2017

brianteeman Jun 18, 2017

brianteeman Jun 18, 2017

brianteeman Jun 18, 2017 •

edited

Loading

brianteeman Jun 18, 2017

brianteeman Jun 18, 2017

brianteeman Jun 18, 2017

brianteeman Jun 18, 2017

brianteeman Jun 18, 2017

brianteeman Jun 18, 2017

yvesh Jun 18, 2017

zero-24 commented Jun 18, 2017

yvesh commented Jun 18, 2017

SniperSister commented Jun 18, 2017

dneukirchen commented Jun 18, 2017

brianteeman Jun 18, 2017


		2. Install `composer` in your system. Read more about [how to install composer](https://getcomposer.org/doc/00-intro.md) here.

		3. Install composer packages using following steps from root directory of this project.


		If you want to see steps then you can use `--steps` option of codeception. Check [full codecept command list here](http://codeception.com/docs/reference/Commands#Run)_

		Note:You can modify the timeout time by setting the value of TIMEOUT constant lower for fast machines and higher for slow computers. The constant located in the file `tests/codeception/acceptance/_bootstrap.php`

[Testing] Add basic setup and sample tests for Codeception System Tests #16743

[Testing] Add basic setup and sample tests for Codeception System Tests #16743

Conversation

yvesh commented Jun 18, 2017 • edited Loading

Summary of Changes

Testing Instructions

Expected result

Actual result

Documentation Changes Required

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

brianteeman Jun 18, 2017 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

zero-24 commented Jun 18, 2017

yvesh commented Jun 18, 2017

SniperSister commented Jun 18, 2017

dneukirchen commented Jun 18, 2017

Choose a reason for hiding this comment

yvesh commented Jun 18, 2017 •

edited

Loading

brianteeman Jun 18, 2017 •

edited

Loading